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Report  Title 

ARO  Report:  AMSRD-ARL-RO-SI  Proposal  Number  54182-LS 

ABSTRACT 

This  work  investigated  the  advantages  of  multi-modality  in  display  capacity  for  various  soldier-critical  tasks  such  as 
visual  search  for  threat  detection.  Experiments  were  conducted  at  differing  sites  using  individuals  of  differing  skill 
level.  Experimental  findings  confirmed  the  multi-modal  advantage  of  joint  signal  presentation  and  ascertained  that 
such  a  multi-modal  advantage  is  found  predominantly  in  the  perceptual  and  decision-making  phases  of  information 
processing  as  opposed  to  purely  the  motor  element.  Further,  we  established  that  improvements  in  processing  speed 
were  due  to  concurrent  tactile  stimulation  while  improvements  in  processing  accuracy  were  due  to  auditory  augmented 
cues,  when  both  were  used  in  conjunction  with  a  visual  search  task  for  threat  evaluation.  THese  latter  advantages 
co-occur  and  thus  represent  important  practical  performance  gains.  This  series  of  experiments  have  resulted  in 
numerous  publications  in  the  open  literature  and  the  operationally  relevant  aspects  of  these  forms  of  basic  investigation 
have  already  been  usefully  deployed. 


ARO  Report.  AMSRD-ARL-RO-SI  Proposal  Number  54182-LS. 


In  accordance  with  the  rubric  for  the  above  named  Grant,  we  are  pleased  to  submit  the  required 
FINAL  REPORT  concerning  the  cited  project. 

Executive  Summary:  Within  the  specified  timeframe  we  have  accomplished  all  specified  Project 
Goals: 

1)  We  have  finalized,  analyzed  and  completed  the  all  of  the  specified  experimental 
procedures.  This  consisted  of  testing  a  number  of  participants  on  the  agreed  research 
protocols.  All  participants  have  completed  all  testing  with  no  adverse  effects  or  events 
reported.  Overall,  there  were  no  problems  or  issues  associated  with  any  of  the  testing 
procedures  in  any  of  the  experiments  conducted.  All  data  have  been  analyzed  and 
presented  as  part  of  a  Conference  papers  or  Journal  Publications  and  Submissions  as 
detailed  in  the  associated  listing  below. 

2)  We  have  finalized,  analyzed,  and  completed  the  final  experimental  procedure  which  was 
conducted  by  our  group  in  association  with  personnel  at  the  United  States  Military 
Academy  (USMA)  at  West  Point,  New  York.  This  consisted  of  testing  a  number  of  cadets 
participants  who  acted  as  a  comparison  group  with  those  examined  in  other  procedures. 
These  data  have  been  analyzed  and  have  also  now  been  presented  in  various  venues, 
again  as  detailed  below.  We  have  now  confirmed  the  multi-modal  advantage  of  joint 
visual  and  tactile  signal  presentation  and  have  ascertained  that  such  a  multi-modal 
advantage  is  found  predominantly  in  the  perceptual  and  decision-making  phases  of 
information  processing  as  opposed  to  the  purely  motor  element.  Further,  we  have 
established  that  improvements  in  processing  speed  are  due  to  concurrent  tactile 
stimulation  while  improvements  in  processing  accuracy  are  due  to  auditory  augmented 
cues  (see  Figure  1).  This  latter  outcome  represents  a  major  finding  and  is  now  being 
considered  for  publication  (see  listing  of  Refereed  Articles).  We  have  confirmed 
important  differences  between  Cadets  (Experts)  and  Undergraduates  (Beginners)  in 
which  there  was  superior  response  times  to  the  tactile  signals  on  behalf  of  the  expert 


group. 


Figure  1:  Objective  performance  measures  showing  the  increase  in  speed  of  response  and  decrease  in  rates 
of  signal  misses  and  false  alarms  with  the  introduction  of  tactile,  auditory  and  combined  tactile  and 
auditory  cueing. 

3)  We  have  completed  the  process  of  programming  and  equipment  completion  for  the 
foregoing  final  experiment,  whose  main  results  are  reported  above.  These  capacities  were 
developed  in  association  with  Researchers  at  NASA  Ames  Research  Center  and  were 
trans-shipped  to  USMA  West  Point  where  the  final  experimental  procedure  was 
completed.  The  facility  has  now  been  recreated  at  UCF  and  we  have  had  contact  with 
personnel  at  ARL-HRED  in  order  to  pursue  further  work  using  this  facility.  Two  Army 
supported  individuals  attending  UCF  (i.e.,  Mr.  J.  Mercado  and  Mr.  T.  White)  are 
currently  pursuing  unfunded  efforts  on  this  multi-modal  issue  which  we  expect  to 
pursue  further.  Our  forthcoming  plans  will  be  discussed  at  the  up-coming  meeting  of  the 
Human  Factors  and  Ergonomics  Society  meeting  in  Boston,  MA  in  later  2012  in 
association  with  other  Army  supported  groups  addressing  this  issue. 


Overall  Conclusion:  Our  work  has  been  completed  on  time  and  on  budget.  Such  was  the 
acceptance  of  the  efforts  at  our  respective  Conferences  that  major  Journal  editors  solicited  our 
submission  of  this  work,  tire  majority  of  which  has  now  reached  full  publication  in  the  open 
literature  with  full  attribution  to  our  respective  sponsors.  We  are  happy  to  answer  any  and  all 
queries  concerning  the  completed  Project.  Such  enquiries  can  be  addressed  to  the  Principal 
Investigator  at  the  contact  address  given  in  the  following  listing. 
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